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RECENT  AND  PAST  DEVELOPMENTS  IN  COMPLEMENTARY  PIVOT  THEORY- 


by 
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University  of  Chicago"^ 

1.  Introduction.  This  year  marks  the  end  of  the  first  decade  of  a stream 
of  research  launched  by  the  appearance  in  196T  of  Herb  Scarf's  paper  [33] 
on  the  approximation  of  fixed  points  of  continuous  maps  via  the  technique  of 
complementary  pivoting.  During  this  ten  year  period  research  has  tended  to 
emphasize  simplicial  approximation  algorithms  for  finding  fixed  points,  or, 
equivalently,  zeros,  of  rather  small  but  "highly  nonlinear"  systems.  Con- 
tributions to  this  stream,  in  the  way  of  algorithms  and  theoretic  results, 
are  due  to,  among  others,  Charnes,  Garcia,  and  Lemke  [ ^ ],  Eaves  [ 7 ],  Eaves 
and  Scarf  [8  ],  Fisher,  Gould,  and  Tolle  [10],  Garcia  and  Gould  [12],  [13], 
[lU],  [15],  Garcia  and  Zangwill  [16],  [iT  ] » Gould  and  Tolle  [I8],  [19],  Kuhn 
[22],  [23],  [2!+],  Lemke  [26],  and  Merrill  [29].  The  interested  reader  should 
also  refer  to  the  many  additional  authors  referred  to  in  the  bibliographies  of 
these  works. 

During  this  past  ten  years  I would  estimate  that  at  least  100  publications 
on  this  topic  have  appeared  either  as  papers  in  scholarly  journals  or  as  Ph.D. 
dissertations,  and  these  have  ranged  from  theoretic  to  computational  studies. 
It  thus  seems  clear  that  momentum  is  gathering  in  this  area.  The  initial  work 
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of  Scarf,  along  with  the  even  earlier  underlying  work  of  Carl  Lemke , has 
mushroomed  into  a prominent  and  quite  active  specialization  in  mathematical 
programming. 

I should  like  to  very  briefly  summarize  only  a few  of  the  many  past 
developments — in  particular  two  with  which  I am  most  familiar.  And  then  I 
will  discuss  three  of  what  I consider  to  be  the  most  exciting  very  recent 
developments.  In  order,  the  topics  will  be  (i)  restarting  (ii)  modification 
for  convergence  (iii)  continuation  and  global  convergence  (iv)  vector  vs. 
scalar  labels  (v)  finding  all  zeros  in  the  complex  domain.  Much  of  the  ensuing 
discussion  is  informal  and  selective,  with  no  pretense  concerning  complete 
coverage.  The  motivation  is  to  give  a subjective  overview  of  some  of  the 
influential  past  developments,  some  of  the  current  work,  and  potential  future  direction 

2.  Restarting.  In  the  first  five  years  of  this  field  considerable  attention 
was  focused  on  the  problem  of  obtaining  a satisfactory  restart  procedure.  The 
initial  algorithm  of  Scarf,  when  terminated,  could  not  be  restarted  (using  a 
finer  grid)  without  retiarning  to  the  original  starting  point,  thereby  obviating 
the  possibility  of  using  information  obtained  the  first  time  through.  For  the 
case  of  vector  labelings  (both  scalar  and  vector  labelings  were  introduced  by 
Scarf  in  his  196?  paper)  the  problem  was  independently  solved  by  Merrill  [29]  and 
Eaves  [ 7 ] . For  the  case  of  scalar  labels  the  problem  was  independently  solved 
by  Fisher,  Gould,  and  Tolle,  presented  in  [9]  and  [lO],  and  by  Kuhn  [2I4]  and  Kuhn 
and  MacKinnon  [25].  It  is  probably  true  that  most  algorithms  today  use  a so-called 
"sandwich"  approach  to  the  restart  problem.  Briefly,  this  involves  selecting  an 
initial  point,  x^,  and  then  using  this  point  as  a base  to  triangulate  the  space 
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R X [O,  l]  (where  n is  the  dimension  of  the  domain  and  the  range  of  the 

fiinction  f to  be  studied.  The  vertices  are  on  the  upstairs  and  downstairs 

layers  x {O}  and  R*^  x {l}  and  the  initial  simplex  contains 
0 fv  " 

X . Each  downstairs  vertex  is  given  an  artificial  label  according  to  its 

r 0 1 


relation  to  an  initial  starting  point  j £ x {O}  . Each  upstairs  vertex 

V 

^ is  labeled  according  to  the  value  of  f at  v.  The  grid  size  is  fixed 

and  beginning  with  the  initial  simplex  a simplicial  path  is  generated  by  com- 
plementary pivoting.  If  the  algorithm  terminates  (with  a complete  simplex)  then 
a new  starting  point  i i in  the  final  complete  simplex  may  be  selected,  a 

J 

new  triangulation  with  a finer  grid  imposed,  this  time  with  reference  to  x , 
and  the  method  repeated.  In  this  way  each  major  cycle  begins,  roughly  speaking, 
where  the  previous  cycle  ended.  This  sandwich  method  can  be  used  in  conjunction 
with  both  vector  and  scalar  labels.  I will  return  to  this  topic  in  Section  5. 

3.  Modification  for  Convergence.  It  is  only  in  the  last  3 or  1*  years  that 

convergence  properties  began  to  be  fairly  well  understood  even  at  the  local  level. 

There  is  still  far  to  go  on  the  global  level.  It  can  be  shown  that  for  trivial 

systems  of  equations  some  of  the  initially  proposed  algorithms  diverged  from 

all  starting  points,  no  matter  how  close  to  a solution.  And  yet,  with  either  a 

new  subscripting  of  the  components  of  f,  or  by  selectively  changing  some  of 

the  f^  to  5 same  algorithm  would  converge  from  any  starting  point, 

3/ 

no  matter  how  far—  from  a solution.  For  example,  consider  the  system 

f^(x^,  x^)  = -x^  + 1 
f2(x^,  x^)  = ^2  “ ^ 

and  suppose  one  attempts  to  find  the  trivial  root  by  using  either  Merrill's  vector 
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> labeling  algorithm  or  any  of  the  original  scalar  labeling  methods.  The 

I I 

j algorithm  will  diverge  from  every  starting  point.  If  we  multiply  f^  by  -1 , 

I j however,  and  then  appiy  these  same  algorithms  to  solve 


X2  - 1 = 0 


we  observe  global  convergence. 

In  early  197^  this  orientation  problem  was  clarified  by  Fisher,  Gould,  and 
Tolle  [10]  under  the  assumption  that  f is  nonsingular  at  a zero,  x*.  Under 
this  condition  let  us  define 

g(x)  = (fCx*^))  ^ f(x) 

If  it  is  assumed  that  is  close  to  x*  then  (f'(x*^))  ^ exists,  and,  moreover, 

the  above  mentioned  algorithms  applied  to  the  problem  of  solving  g(x)  =0  will  con- 
verge to  x*(a  root  of  f and  of  g)  . It  was  thus  shown  that  by  modif5’'ing  the 
original  function  f(x)  a Newton-like  local  convergence  result  is  obtained. 

At  least  two  prominent  problems  on  convergence  remain.  Let  us  first  note 
the  perhaps  obvious  fact  that  complementary  pivoting  methods  are  slow.  If  a 
good  initial  estimate  of  x*  is  available  then  either  Newton's  method  or  a 
quasi-Newton  method  is  to  be  preferred  because  of  the  quadratic  convergence 


properties.  For  real  algebraic  equations,  however,  the  domain  of  convergence 
of  such  methods  tends  to  be  inversely  related  to  the  degree  and  the  number  of 
the  equations.  Consequently,  for  highly  nonlinear  systems  it  is  not  surprising 
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to  find  a very  small  domain  of  convergence.  It  is  precisely  when  the  initial 
estimate  may  not  be  close  enough  that  the  slower  complementary  pivoting  methods 
may  be  preferable.  Thus  local  convergence  results  for  complementary  pivoting 
feLll  short  of  what  we  are  really  after — namely,  good  global  results.  These 
are  just  beginning  to  appear  and  will  be  discussed  in  the  next  section. 

The  second  problem  alluded  to  above  is  that  for  highly  nonlinear  systems 
f'(x*^)~^  may  be  quite  expensive  or  even  impossible  to  obtain  analytically.  To 
date  there  has  been  little  in  the  way  of  reported  experience  on  using  either 
discrete  approximations  or  other  matrix  iterations  to  replace  this  term. 

U.  Continuation  and  Global  Convergence.  Continuation  methods  for  solving 
nonlinear  equations  date  back  at  least  to  work  of  Davidenko  in  1953  [ 5 ],  and 
have  been  rediscovered  many  times  since  [ll],  [ 6 ],  [21 ],  [20],  [30],  [32],  [ 3 ]*  [ 2 ] 
It  .'.ow  appears  that  simplicial  approximation  can  be  viewed  as  yet  another  re- 
discovery of  a continuation  method,  albeit  an  especially  attractive  method — 
especially  attractive  because  Jacobian  singularities  do  not  create  the  obstacle 
they  do  with  other  such  methods.  In  order  to  explain  some  of  the  recent  results 
in  this  area,  let  H:  -►  be  a C^  map,  let  x denote  a point  in  R^, 

t a scalar  variable,  and  suppose  H(x,  t)  has  the  following  homotopy  properties: 

H(x,  0)  = f(x),  H(x^,  l)  = 0 for  some  known  x^ 


Two  prominent  examples  are: 

(1)  H(x,  t)  = f(x)  - t f(x*^)  (the  Newton  homotopy) 

(2)  H(x,  t)  = t(x  - x*^)  + (l  - t)  f(x)  (the  Levenberg-Marquardt  homotopy) 
where  in  either  case  x^  is  a given  initial  point  in  r"  and  t g [O,  1].  The 


continuation  method  considers  the  set  of  points  (x,  t)  for  which 
(3)  H(x,  t)  = 0. 

Previous  works  on  continuation  have  generally  suffered  from  the  assumption 
that  there  exists  a continuous  solution  curve  x(t)  such  that  for  t £ fO,  l] 

(x(t),  t)  is  a solution  of  (3)  and  that,  moreover,  H^(x(t),  t)  is  nonsingular 
for  aJ.1  t g [O,  l].  Under  these  strong  assumptions  it  follows  from  the  implicit 
function  theorem  that  x(t)  satisfies,  for  t g [O,  l], 

(i*)  0 = -r^  H(x(t) , t)  = H -x  + H , x(l)  = x^,  or 
(5)  X = -H  ^ H , x(l)  = x*^ 

X u 

dx 

where  x denotes  — . Conversely,  if  x(t)  is  a solution  of  (5)  on  [O,  l] 

CLo 

then,  by  (U),  H(x(t),  t)  is  constant  for  t ^ [O,  l]  and  f(x{0))  = H(x(0),  0)  = 
H(x(1),  l)  = H(x^,  l)  = 0.  Thus  .x(0)  is  a root  of  f(x).  This  means  that 
f(x)  =0  can  be  solved  by  numerically  integrating  the  differential  equation  (5) 
and  "continuing"  the  solution  curve  x(t)  from  the  known  point  x*^  = x(l)  to 
the  root  x(0). 

It  is  not  difficult  to  show  that  if  the  differential  equation  (5)  correspond- 
ing to  the  homotopy  (l)  is  integrated  by  Euler's  method  then  essentially  the 
Newton  iterations  are  obtained  [32],  For  the  differential  equation  corresponding 
to  the  homotopy  (2)  a variant  of  the  Levenberg-Marquardt  method  [27],  [28],  [1  ] 
is  obtained. 

Now  we  discuss  the  relations  between  homotopies  and  complementary  pivoting. 

It  has  been  known  for  some  time  that  the  set  H(x,  t)  = 0,  where  H is  given 
by  (2),  is  followed  in  a limiting  sense  (piecewise  linearly)  by  Merrill’s  algorithm. 
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The  set  H(x,  t)  =0  where  H is  given  by  the  Newton  homotopy  (l)  has  been 
recently  arialyzed  [151  in  detail  and  it  has  been  shown  that  (i)  the  assumption 
on  the  existence  of  a solution  curve  x(t)  can  be  dropped  and  (ii)  singularities 
of  f’(x)  do  not  cause  the  usual  problems.  In  particular,  let  z = (x,  t)  £ 
and  suppose  f(x)  and  hence  H(z)  given  by  (l)  is  C . Let  H'(z)  denote 
the  n X n +■  1 Jacobian  matrix  [H  (z),  H (z)]  = [f  (x),  -f(x^)],  and  suppose 

X X/ 

reuik  H*  = n for  all  (x,  t)  in  R satisfying  (3).  If  this  assumption 
is  not  satisfied  it  will  be  (by  Sard's  Theorem  [35])  for  an  arbitrarily  small 
pertxirbation  of  the  right  hand  side  of  (3).  Hence,  for  computational  purposes 
the  rank  n assumption  is  quite  valid.  Under  these  assumptions,  the  points 
(x,  t)  in  H ^(O)  form  a one-dimensional  manifold  [31].  Each  (connected) 

component  of  H ^(O)  can  therefore  be  described  by  a function 

z(9)  = (x(9),  t(9))  which  is  diffeomorphic  to  a circle  or  an  interval. 

Now  let  (x(9),  t(0))  denote  the  component  of  H ^(O)  containing  (x^,  1) 
where  x(0)  = x^,  t(0)  = 1.  Hence  f(x(9))  - t(9)  f(x*^)  = 0.  Beginning  at  x^ , 
the  projection  of  this  component  into  R*^  can  be  traced  with  complementary 
pivoting  on  an  appropriately  labeled  triangulation  of  R*^. 

Note  that  x(9),  t(9)  also  satisfy  the  following  differential  equation: 


0 = H ^ ^ 

X d9  t r 


f(x(0))  f(x°)  § 


f(x(9)  f - 


f(x(9)) 

t(0) 


dt 

d9 


for  t(9)  ^ 0.  That  is 
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(6)  f'(x{0))x(e)  = llll  f(x(0)),  (x(0),  t(0))  = (x°,  1)  .all  03  t(0)  i 0 

This  is  closely  related  to  an  equation  studied  by  Eranin  [2]  and  later  by  Smale  [ 
The  following  recent  path  theorem  [1^*]  shows  that  t(0)  = 0 <=“>  dot  f'(x(0))  = 0. 
for  t(0)  / 0,  f'(x(0))  ^ exists,  and  for  such  values  of  0,  provided  t(0)  i-  0 
x(0)  in  (6)  is  aJ-ways  either  in  the  Newton  direction  or  the  negative  of  the 
Newton  direction,  depending  on  the  sign  of  t(0)/t(0). 


A Path  Theorem; 


Let  H: 

2 

be  C and 

0 a regular  value  ofH  (i.e.,H'(z 

has 

rank 

n V z 

€ H‘^(0)). 

Then  for  any 

component  z(0)  of  H ^(O)  we  have 

for 

i = 

1 , • • • , 

n + 1 

sgn  z^(0)  = sgn  det  H^(x(0)),  all  0 
or 

sgn  z^(0)  = -sgn  det  H^(x(0)),  all  0 
where  sgn  0=0,  and  denotes  all  columns  of  H'  but  the  i^^. 

For  the  Newton  homotopy  this  theorem  implies 

sgn  t(0)  = sgn  det  f'(x(0)),  all  0 
or 

sgn  t(0)  = -sgn  det  f'(x(0)),  all  0 


3U]. 
Hence , 


Also,  from  the  above  path  theorem,  it  is  clear  that  for  the  Newton  homotopy 
t(0)  is  strictly  monotonic  (and  hence  invertible  to  obtain  0(t))  on  a particular 
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component  of  H ^(0)  iff  f'(x(9))  is  nonsinf'i.:  ir  on  that  component  and  hence 

only  under  this  condition  can  x(G)  be  expressei  an  a function  of  t 

(i.e.,  x(0(t)),  and  even  so  it  need  not  be  true  that  t varies  between  0 

and  1 on  this  component.  On  the  other  hand,  if  f has  a singularity  on  a 

component  then  it  cannot  be  expected  that  x will  be  a function  of  t on 
that  component  and  the  usual  continuation  methods  will  most  likely  encounter 
difficulty.  Such  a singularity  should  not  be  considered  particularly  pathological. 
As  an  illustration  consider  the  following  simple  example  due  to  Freudenstein 
and  Roth  [ 11 ] . 


f^(xj^,  x^)  = -13  ^3^  ■ 2X2  + 5X2  - x|  = 0 


2 

f2(x^,  X2)  = -29  + x^  - 1^X2  + X2  + X2  = 0 


Here,  letting  H(x,  t)  be  given  by  (l),  and  taking  x = (15,  -2),  we  obtain 


H’(x,  t)  = 


-2  + 10x2  - 3x2 


-3»+ 


0, 


-Ih  + 2x2  + 3x2 


= [f’(x),  -f(x")] 


-10 


It  can  be  easily  verified  that  = f'(x)  is  singular  whenever  .X2  = 2.23  or 


X2  = -.897.  In  Figure  1 it  is  seen  that  the  path  H(x,  t)  = 0 crosses  each  of 


these  lines.  Both  Newton's  method  and  Broyden's  quasi-Newton  continuation  method 


have  been  reported  to  fail  (starting  at  x = (15,  -2))  on  this  example.  The 


simplicial  approximation  G algorithm  [13],  [l5l  can  be  shown  to  converge  to  the 


unique  root  at  (5-0,  U.O). 


In  order  to  illustrate  the  application  of  complementary  pivoting  and  simplicial 
approximation  let  us  focus  on  the  Newton  homotopy 


beginning  at  , t may  well  become  greater  than  1 on  the  homotopy  path 

2(6)  before  encountering  the  value  zero  (at  which  time  a root  of  f is  at 


hand).  For  H as  given  by  (7),  the  projection  into  of  the  component  of 

H ^(0)  containing  the  point  x^  can  be  tracked  in  a precise  limiting  sense 
by  the  Garcia  Gould  algorithm  discussed  in  [15]  and  [13].  The  algorithm  is 
always  initiated  with  0 = 0 at  x(0)  = x^  such  that  det  f'(x*^)  4 0,  and 
t(0)  = 1.  Also  we  always  move  initially  in  such  a way  that  t(0)  < 0.  This 
means  that  the  initial  direction  is  always  Newton  (since  < 0 in  expression 

(6)).  The  negativity  of  t(0),  along  with  the  path  theorem,  also  implies 

det  f'(x*^)  > 0 =>  sgn  t(0)  = -sgn  det  f'(x(0)),  all  0 

det  f'(x'^)  < 0 =>  sgn  t(0)  = sgn  det  f'(x(0)),  all  0 . 

Thus,  for  all  0 3 t(0)  > 0, 

det  f ' (x^ ) > 0 =>  x( 0 ) is  Newton  <=>  det  f'(x(0))  > 0 

det  f ' (x^)  < 0 =>  x(0)  is  Newton  <=>  det  f’(x(0)'i  < 0 

Concerning  convergence,  the  following  interesting  global  result  is  initially 
due  to  Smale  [3^]; 

Suppose  there  is  an  open  bounded  set  C such  that  f:  C -*■  C and 

3C  are  connected,  3C  smooth,  and  x g 3C  =>  det  f'(x)  > 0 and  f'(x)  ^ f(x) 

2 0 

intersects  9C  transversally  at  x.  Suppose  f C , x € 3C,  and  rank  H'(x,  t)  = n 
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for  all  (x,  t)  in  H ^(O).  Then  the  projection  into  of  the  connected 

component  of  ir^(O)  containing  (x^,  l)  will  contain  a zero  of  f. 

Although  the  conditions  of  this  theorem  are  weak  (nonsingularity  of 

f'(x)  on  x(0)  is  not  assumed)  it  is  clear  from  the  simple  example  in  Figure  1 

that  they  are  still  too  strong.  It  can  be  seen  in  this  figure  that  if  x*^  € 9C, 

for  any  open  bounded  connected  C containing  x*,  then  3C  will  contain  U 

points  at  which  det  f = 0.  In  fact,  a necessary  and  sufficient  condition  for  the 
2 

G algorithm  to  encounter  a regular  zero  (at  which  det  f 0)  is: 


There  exists  a point  (x(0),  t(0))  on  the  path  (x(0),  t(0))  such  that 
(i)  sgn  det  f'(x  ) = sgn  det  f'(x) 

i.e.,  det  f'(x)  changes  sign  an  even  number  of  times  between 
X and  X . 

(ii)  x(0)  is  the  negative  of  the  Newton  direction.  The  sufficiency 
is  proved  by  observing  that 


T _-,„/t(0)\_  sgn  t(0)  -1  ^ 

1 - sgnj  — X—  j-  — X—  = =>  sgn  t(0)  = -1  . 

\ t(0)  } sgn  t(0)  sgn  t(0) 


The  necessity  can  be  seen  by  noting  that  the  sign  of  x(0)  reverses  each  time 
t(0)/t(0)  changes  sign.  Letting  0 be  the  first  0 value  such  that 
f(x(0))  = 0,  the  sign  of  t(0)  at  0 + e,  for  small  e,  will  have  undergone 
one  reversal  (t(0)  ^ 0 since  det  f'(x(0))  ^ O).  By  the  Newton-Kantorovich 
Theorem  x(0  + e)  has  the  negative  Newton  direction.  Hence  t(0)  and  therefore 
det  f has  reversed  sign  an  even  number  of  times.  Examples  of  this  result  are 


aiiiiiSI!i3SE< 
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In  concluding  this  section  we  make  note  of  several  additional  convergence 
properties.  Suppose  the  component  of  H ^(O)  containing  (x^,  l)  is  an 
^unbounded  path.  Assume  that  on  this  path  x eventually  has  the  negative  of  the 
Newton  direction.  Also  assume  that  det  f'(x)  # 0 

if  X 6 f~^(0)  (so  that  a zero  corresponds  to  a change  in  sign  of  t).  Then  we 
have  the  opposite  parity  result : 

# reversals  in  det  f is  even  (odd)  <^>  § zeros  on  path  is  odd(even). 

This  is  proved  by  noting  that  an  even  (odd)  number  of  reversals  in  det  f 
(i.e.,  in  t)  gives  an  even  (odd)  number  of  reversals  in  the  sign  of  x . Since 
X is  initially  in  the  Newton  direction,  and  eventually  in  the  negative  of  the 
Newton  direction,  an  even  (odd)  number  of  reversals  in  det  f’  implies  an  odd 
(even)  nximber  of  reversals  in  t (=  # zeros). 

From  this  opposite  parity  result  it  follows  that  an  unbounded  path  must 
contain  either  a zero  or  an  odd  nimber  of  reversals  in  det  f ' . Note  that  any  path 

in  is  unboianded  and  this  result  applies  (c.f.  Figures  2 and  3)  • 

If  the  component  of  H ^(O)  containing  (x*^,  l)  is  a loop  (n  must  be  >1), 

there  must  be  an  even  number  of  reversals  in  det  f and  an  even  number  of  zeros. 

• • 

This  follows  from  the  fact  that  t(l)  = t(0)  < 0 and  hence  the  reversals  in  det  f 

are  even  in  number.  Also,  since  x is  continuous  and  x(0)  f 0,  there  must  be  an 

• • 

even  number  of  reversals  in  t/t  and,  since  even  in  t,  also  even  in  t. 

From  these  comments  it  follows  that  if  there  is  a unique  zero  then  it  lies 
on  an  unbounded  path  with  an  even  number  of  reversals  in  det  f ' . This  case  is 
illustrated  in  Figure  1. 
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As  a final  comment,  examples  can  be  found  for  which  solving  Smale's 
2 

equation,  or  using  G on  the  Newton  homotopy  (7)  (which  has  an  advantage 
that  many  roots  can  possibly  be  located)  has  the  interesting  property  that  con- 
vergence occurs  when  starting  far  away,  or,  as  usual,  from  very  close,  but  not 
from  intermediate  points.  Also,  it  is  not  yet  clear  what  classes  of  functions 
satisfy  the  above  discussed  convergence  conditions.  Thus,  from  the  viewpoint 
of  global  convergence,  these  continuation-like  methods  leave  many  important 
questions  to  be  answered. 

5.  Vector  versus  Scalar  Labels.  Another  area  under  active  pursuit  involves 
the  question  of  relative  efficiency  between  vector  and  scalar  labels.  The 
vector  labeling  procedure  requires  the  solution  of  a linear  system  at  each 
iteration  (each  time  a vertex  is  eliminated).  In  the  sandwich  method,  then,  for 
tracking,  for  example, 

(8)  H(x,  t)  = t(x  - x°)  + (1  - t)  f(x)  =0,  X 6 r",  t e [ 0,  1] 

2 

with  vector  labels  an  order  of  (n  + l)  multiplications  are  required  per  pivot. 
It  has  recently  been  demonstrated  that  each  of  the  homotopies  (T)  and  (8)  can 
be  tracked  with  scalar  labels,  and,  moreover,  a sandwich  is  not  required  [l2j, 
[13].  Thus,  only  an  order  of  n m\iltiplications  per  pivot  is  required.  Con- 
sidering a given  homotopy,  such  as  (7)  for  example,  we  then  have  the  result  that 
precisely  the  same  path,  in  a limiting  sense,  is  followed  by  either  a vector  or 
a scalar  labeling.  However,  this  does  not  imply  that  the  simplicial  paths  will 
be  identical  for  these  two  procedures.  Herb  Scarf  has  conjectured  that,  for 
example,  the  scalar  path  will  "wiggle"  more  than  the  vector  path,  for  the  vector 
path  enjoys  the  property  that  on  each  simplex  a piecewise  linear  approximation 
to  H(x,  t)  = 0 is  obtained.  However,  even  if  the  scalar  path  would  require 


i 
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more  iterations  (and  this  is  not  yet  clear),  it  would  remain  to  determine  which 
method  on  net  involves  more  computational  work. 


Indeed  there  are  other  scalar  labeling  methods  which  were  proposed  in  the 
early  1970 's.  Limited  evidence  suggests  that  these  earlier  methods  are  not 
as  effective  as  the  vector  methods,  at  least  via  the  sandwich  approach,  but 
it  would  seem  to  be  of  interest  to  explore  such  methods  in  conjunction  with  a 
full  triangulation  of  x [O,  l],  i.e.,  triangulate  the  n + 1^^  dimension 
as  well  as  R*^.  One  could  then  apply  scalar  labels  to  H(x,  t)  and  this  would 
provide  yet  another  means  for  tracking  H(x,  t)  = 0,  beginning  on  R*^  x {i}. 


6.  Finding  All  Zeros  in  the  Complex  Domain.  Perhaps  the  most  exciting  recent 
work  in  the  field  is  due  to  Garcia  and  Zangwill  [l6j,  [17]  and  gives,  for  the 
first  time,  a systematic  and  fail-safe  method  for  finding  all  roots  of  certain  systems 
of  n equations  in  n complex  variables.  The  work  applies  to  arbitrary  poly- 
nomials and  even  more  general  systems.  The  approach  presented  goes  roughly  as 
follows.  One  wishes  to  solve 


Pj(z)  .0,  3=1,. 

where  each  Pj : c”  -*  C is  analytic  and  P(z) 
The  system 

(9)  (1  - t)  Q (z)  + t P (z)  = 0,  J = 1 


. , n , 

= 0 has  a bounded  solution  set. 

. . . , n (t  € R) 


is  considered,  where 

(a)  the  set  of  solutions  to  the  "simple  system"  Q(z)  =0  is 


bounded  and  known 


IT 


P (z) 

(b)  if  ||z||  then,  for  some  j,  lim  q , if  real,  i£ 

not  negative. 


Each  knovm  solution  at  t = 0 serves  as  a starting  point.  The  simplicial  path 

will  either  diverge  to  infinity  as  t -<■  1 or  will  terminate  at  t = 1. 

Moreover,  each  path  starting  from  a solution  to  P.(z)  = 0 (at  t = l)  will 

J 

link  to  t = 0.  This  is  subject  to  the  assumption  that  0 is  a regular  value 
of  (9),  which  is  satisfied  with  probability  one.  The  above  properties  imply  that 
all  roots  of  P(z)  = 0 will  be  hit  by  a subset  of  the  paths  leading  from  the 
known  solutions  (at  t=0)  to  Q(z)~0.  This  work  has  obvious  and  important 
implications  for  global  optimization  where  the  optimxjm  optimorium  of  a nonconvex 
(or  noncave)  differentiable  function  is  sought. 
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